Next is that the research report provides all the details necessary to effectively assess the quality of the research method, including such revealing information as the sample size and composition, what control group or groups were used, the reliability of measurements of the intervention impact, and so on. Third is that relationship between the intervention and the outcome is real and the impact of the intervention is statistically significant. Fourth is that target behavior of the research is clearly defined and that this behavior is what was measured. Last is the ability to generalize the results across situations beyond those presented in the study. A quality rating system, either simple or weighted, can be devised to score studies according to these standards.
In 1997, a research team led by Paul Brounstein used a similar set of standards to examine the quality of the evaluations of alcohol abuse prevention programs. Using the standards, each evaluation was rated on a scale of 1 to 5, with scores of 3 to 5 representing acceptable to high quality. Of the 440 evaluations...
57). The researchers were able to apply the standards to separate the wheat from the chaff, and thus concerned policymakers know which alcohol abuse studies to take seriously when reviewing the literature on prevention programs.
Policymakers in this organization should adopt Farrington's methodological quality standards to ensure their policy is based on the best research available. Doing so will provide strong scientific evidence to offer to constituents and other officials in support policy decisions and will create a culture of critical analysis and research literacy that will promote and enhance organizational effectiveness in the future.
References
Farrington, D.P. (2003). Methodological quality standards for evaluation research. The Annals
of the American Academy of Political and Social Science, 587, 49-68.
doi: 10.1177/0002716202250789
Tufte, E.R. (1974). Data…
